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FOREWOHD 

This  report  summarizes  results  of  an  effort  to  establish  a  consumer 
panel  by  following  probability  sampling  procedures.     Tte  effort  was  under- 
taken by  the  Market  Research  Corporation  of  America   (formerly  Industrial 
Surveys  Company)    as  a  part  of  a  contract  under  the  Agricultural  Marketing 
Act  of  19U6   (RMA,   Title  II).     This  Act  authorizes  the  collection  and  dis- 
semination of  marketing  information   "for  the  purpose  of  anticipating   and 
meeting  consumer  requirements,    aiding  in  the  maintenance  of  farm  income 
and  bringing   about  a  balance  between  production  and  utilization  of  agricul- 
tural products. " 

The  term  "consumer  panel"  refers  to   a  sample  of  households  that  maintain 
records  of  their  day-to-day  purchases  of  many  specified  items  and  report 
by  mail  each  week.      Such   a  panel  has   been  maintained  on  the   basis  of  quota 
sampling  by  the  contractor  since  19U2. 

^y  the  terms  of  the  contract  with  the  Market  Research  Corporation  of 
America,   monthly  data  on  consumer  purchases  of  specified  fruits  and  fruit 
products  are  provided.      In  addition,    the  contract  provided  for  a  study, 
with  the  consumer-panel  technique:      (1)  To  determine  the  rate  of  cooperation 
that  can  be  obtained  from  a  probability  sample  of  households  under  a 
specified  system  of  incentive  and  inducement;    and  (2)   to  obtain  some  obser- 
vations of  the  characteristics  of  those  households  willing  and  able  to 
cooperate  versus  those  unwilling  or  unable  to  participate. 

The  project  was  vindertaken  in  two  parts:     The  first  was  in  the  New  York 
Metropolitan  area  with  a  probability  sample  of  5U6  households.      (See  "Prob- 
lems of  Establishing  a  Consumer  Panel  in  the  New  York  Metropolitan  Area," 
U.   S.  Department  of  Agriculture  Marketing  Research  Report  8,   May  1952.) 
The  second,   which  is  discussed  in  this  report,    covers  the  efforts  undertaken 
to  obtain  cooperation  from  1,120  households  in  a  nationwide  probability 
sample,    exclusive  of  the  New  York  area. 

Two  of  the  possible  types  of  errors  in  the  measurements  of  consumer 
purchases  by  means  of  a  sample  of  consumers  are:      (1)   The  sample  bias  that 
results  from  failure  to  obtain  initial  or  continued  cooperation  from  all 
households  randomly  selected;    and  (2)   the  reporting  errors  encountered  in 
ascertaining  the  purchases  by  any  individual  household.     The   cons'imer-panel 
technique,   based  upon  diary  recording  of  purchases,   is  considered  to   oe 
effective  in  reducing  errors  of  memory,   but  this   approach  has  the  difficulty 
of  obtaining   a  high  rate  of  cooperation.     With  the  technique  of  the  "one- 
time" survey  a  high  rate  of  cooperation  can  be  obtained  from  a  probability 
sample,   but  the  results  may  contain  large  errors  owing  to  imperfect  recall 
of  purchases  made.     No   attempt  was  made  in  this  project  to  compare  the 
errors  in  these  two  methods,   nor  to  resolve  the  conflicts.     Although  this 
report  is  limited  to  the  problems  associated  with  the  collecting  of  consumer- 
purchase  data  by  consumer  panels,   it  should  be  of  interest  to  statisticians 
and  marketing  analysts  working  in  this  field. 

Earl  E.    Houseman,   Statistician 
Bureau  of  AgitLcultural  Economics 
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ESTABLISHING  A  NATIONAL  CONSU?ffiR  PANEL 
FROM  A  PROBABILITY  SAMPLE 

Prepared  by  Market  Research  Corporation  of  America 
under  contract  as  authorized  by 
the  Agricultural  Marketing  Act  of  I9U6  (RMA,  Title  II) 
Edited  for  publication  by  the  Bureau  of  Agricultural  Economics 

BACKGROUJro  AND  SUMMARY 

The  con  sinner -panel  technique  is  a  system  of  measuring  purchases  of 
a  continuing  sample  of  consumers  by  means  of  day-to-day  recording  by  each 
family  of  its  purchases  on  a  continuous  basis.  The  objective  of  the 
consumer-panel  technique  is  twofold;   (1)  To  obtain  an  accurate  measure- 
ment of  consumer  purchases  on  a  current  basis  at  the  consumer  level  so 
that  they  may  be  analyzed  in  total  or  in  part  by  various  consiiner  charac- 
teristics; and  (2)  to  obtain  continuing  or  repetitive  information  from 
the  same  fairiilies  so  that  changes  in  buying  habits  on  a  short-  or  long- 
term  basis  may  be  compiled  on  an  individual -family  basis,  thus  facilitating 
the  analysis  of  internal  shifts  and  the  analysis  of  change.  It  is  in  this 
latter  respect  that  the  consumer-panel  technique  differs  from  both  the 
one-time  or  repetitive  consumer  surveys  which  measure  purchases  for  only 
short  periods  of  time  from  successive,  independently  drawn  samples,  and 
the  one-time  samples  which  do  not  attampt  to  measure  purchases  of  individ- 
ual families  for  any  extensive  historical  periods.   An  essential  effort 
of  the  consumer-panel  technique  is  to  overcome,  by  means  of  daily  recording, 
the  human  inability  to  recall  past  events  accurately. 

A  panel  member  is  expected  to  record  information  on  purchases  of  many 
selected  food  and  personal-care  items  in  the  appropriate  spaces  provided 
in  a  printed  booklet  referred  to  as  a  "diary,"  and  at  the  end  of  each  week 
to  forward  by  mail  the  diary  that  covers  the  purchases  for  the  week.  The 
average  number  of  entries  per  week  is  about  17.  Entering  this  number  of 
items  in  the  diary  is  estimated  to  take  from  10  to  30  minutes  a  week. 
For  participating  in  the  panel,  the  households,  as  explained  later,  are 
remunerated  in  terms  of  "points"  that  can  be  exchanged  for  merchandise. 

During  the  first  5  months  of  1^51  most  of  the  work  of  contacting  a 
national  (exclusive  of  New  York  City)  probability  sample  of  1,120  house- 
holds to  seek  their  participation  in  a  panel  was  done.   IntenrLewers  were 
instructed  to  make  not  more  than  three  calls  in  an  effort  to  contact  a 
household  and  not  more  than  two  actual  interviews  to  discuss  panel  member- 
ship, unless  additional  calls  could  be  made  with  little  additional  time  or 
travel.  Households  that  agreed  to  cooperate  remained  in  a  training  status 
for  about  2  months  or  longer. 

Briefly,  the  results,  in  terms  of  cooperation,  were  as  follows:   (1)  68, 
or  6  percent,  of  the  1,120  selected  dwelling  units  were  either  vacant,  had 
not  been  called  on  before  the  date  used  for  summarizing  results,  or  the 
households  were  ineligible;  (2)  59  households,  or  about  5  percent,  were  not 


-  u  - 

contacted  because  of  the  llTiits  placed  upon  the  number  of  not-at-horae  callsi 
and  (3)  of  the  remaining  993  households,  58  percent  agreed  to  cooperate 
and  did  so  to  the  extent  of  sending  in  one  or  more  diaries,  U6  percent 
cooperated  to  the  extent  of  continuing  through  the  training  period,  and 
6  Tionths  after  completion  of  the  training  period,  }S   percent  of  the  ^^'^i 
households  were  reporting  regularly. 

In  the  metropolitan  area  of  New  lork  the  initial  cooperation  rate  was 
the  sane;  that  is,  310  householris  of  53'-i  eligible  households  called  on,  or 
58  percent,  cooperated  to  the  extent  of  sending  in  one  or  more  diaries.  1/ 
About  9  to  10  months  after  the  average  date  on  which  the  households  agreed 
to  cooperate,  35  percent  were  still  reporting.  The  percentage  of  regular 
reporters,  if  made  comparable  to  that  for  the  national  sanrole,  would  oe 
somewhat  larger. 

Most  of  the  differences  in  family  characteristics  between  cooperating 
and  noncooperating  households  were  not  statistically  significant.  However, 
cooperation  tended  to  be  best  among  households  having  housewives  in  the 
younger  age  groups  and  households  having  more  than  two  memoers.   These 
results  are  consistent  with  findings  in  the  New  York  Metropolitan  area, 
which  are  summarized  in  a  later  section,  page  l6. 

The  opinion  of  the  investigators,  as  a  result  of  this  and  earlier  work, 
is  that  success  in  obtaining  the  initial  and  continued  cooperation  of  a 
random  sample  of  households  depends  upon  three  factors:  persuading  families 
to  cooperate  (communication),  providing  for  cooperation  (incentive),  and 
the  burden  imposed  on  the  cooperator  in  keeping  records. 

Persuading  Households  to  Cooperate  (Communication).  —  Success  in 
securing  cooperation  depends  on  the  literacy  of  the  household,  the  manner 
with  which  the  investigator  presents  the  program,  the  confidence  engendered 
in  the  household  in  the  organization  making  the  survey  and  its  representa- 
tive, getting  the  household  to  understand  the  purpose  of  the  project,  and 
assuring  the  household  that  it  will  not  be  asked  to  "ouy"  something  and 
also  that  the  reports  will  not  be  used  by  local,  State,  or  National  Govern- 
ment in  any  way  disadvantageous  to  them. 

Incentive.  —  /mother  important  factor  is  the  incentive  provided  for 
cooperating  -  amount  of  monetary  compensation,  the  help  it  will  give  the 
field  representative  and  the  company  in  securing  needed  information,  the 
indirect  social  benefits  of  participating  in  a  useful  community  or  national 
project,  and  the  community  or  neighborhood  prestige  implied  in  the  house- 
hold's selection  as  a  panel  fajoily. 

Burden  Imposed  on  Cooperator.  —  The  keeping  of  accurate  records  imposes 
a  varying  degree  of  burden  among  types  of  households;  and  in  any  one  house- 
hold it  represents  a  varying  degree  of  burden  at  different  times  of  the 
year  -  work  load  of  other  activities,  temporary  dislocation  of  family  because 


1/  Industrial  Surveys  Company.   Problems  of  Establishing  a  Consumer  Panel 
in  the  New  York  Metropolitan  Area.   U.  3.  Uept.  Agr.  Marketing  Researcn 
Rept.  8,  Ul  pp.  May  1952. 
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of  changing  jobs,  moving,  illness,  birth  of  children,  vacations,  and  similar 
situations.   A  cooperator' s  degree  of  literacy  has  consideraLlt*  to  do  also 
with  the  difficulty  or  lack  of  difficulty  he  mgy  experience  in  keeping 
records. 

In  executing  this  project,  investigators  noted  that  (1)  subsequent 
contacts  with  a  household  by   the  field  representative  could  establish  com- 
munication when  initial  attempts  had  failed,  (2)  satisfactory  communica- 
tion could  in  some  instances  be  established  by   one  field  representative 
where  another  had  failed,  {})    different  types  of  incentivns  as  well  as 
different  levels  of  incentive  would  obtain  cooperation  in  some  households 
where  the  single -standard  system  would  fall,  and  (U)  continued  cooperation 
could  be  obtained  in  some  households  which  failed  to  cooperate,  if  it  were 
possible  to  provide  temporary  or  permanent  assistance  in  the  record-keeping 
job  each  week  by  a  field  representative. 

This  effort  did  not  provide  a  solution  to  the  problem  of  getting  a  rate 
of  cooperation  in  a  randomly  selected  sample  of  households  high  enough  to 
elijninate  the  possibility  of  bias  due  to  nonresponse.   Further  research  or 
experimentation  on  the  degree  of  cooperation  obtainable  under  different 
sj'stems  of  communication,  incentive,  and  of  assistance  given  the  households 
might  indicate  practical  means,  in  consideration  of  cost,  of  obtainir-g 
considerably  higher  sustained  rates  of  cooperation.   It  appears  that  other 
attacks  on  the  problem  are  also  needed  —  attacks  directed  at  evaluating 
any  biases  due  to  noncooperation  and,  if  necessary,  developing  techniques 
for  making  adjustments.  As  pointed  out  above,  most  of  the  differences  in 
characteristics  of  the  cooperating  and  noncooperating  families  in  the 
probability  sample  were  not  statistically  significant  but  this  does  not 
provide  positive  assurance  that  appreciable  nonresponse  oiases  do  not 
exist  for  other  items. 

METHODS  AND  PROCEDURES 

Design  of  the  Sample 

As  problems  of  sample  design  were  outside  the  scope  of  the  study,  only 
a  brief  account  of  the  sample  design  is  given  here.  For  purposes  of 
sampling,  the  United  States  was  divided  into  twopsubuniverses:   (1)  Seventy- 
three  of  the  largest  standard  metropolitan  areas— 'and  (2)  the  remainder  of 
the  United  States,  Within  each  of  these  subuniverses  the  sampling  was 
carried  out  in  four  stages:   (1)  Selection  of  primary  samplir-g  units  -  23 
standard  metropolitan  areas  from  the  first  subuniverse  and  hS   counties 
from  the  second;  (2)  selection  of  places  (incorporated  and  unincorporated 
villages,  towns,  and  cities);  (3)  selection  of  blocks  or  other  small  areal 
segments;  and  (k)    selection  of  sample  dwelling  units  within  the  designated 
blocks  or  areal  segments. 

Sampling  in  the  first  and  second  stages  was  stratified  random  with 
probabilities  of  selection  proportional  to  population.   In  stage  three  the 


2/  These  are  the  metropolitan  areas  defined  by  a  Federal  interagency 
committee,  which  was  set  up  late  in  19h7   under  the  direction  of  the  Bureau 
of  the  Budget, 
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areal  segments  or  blocks  were  selected  by  using  stratified  randon  sampling 
with  probabilities  proportional  to  number  of  dwellings  if  such  information 
was  available.  Otherwise  the  selection  was  with  equal  probabilities.   In 
stage  four  the  dwellings  within  the  specified  sample  areas  were  listed  as 
a  basis  for  sampling  within  the  areas.   Very  little  clustering  of  the  sample 
occurred  within  the  priraaiy  sampling  units;  usually  only  one  sample  house- 
hold was  selected  from  a  sample  area. 

Selection  of  Interviewers 

Most  of  the  interviewers  were  obtained  from  three  sources:   (1)  Vvonen 
already  working  for  the  company  on  its  retail-store  audits-,  (2j  women 
who  had  previously  indicated  an  interest  in  this  type  of  work,  and 
(3)  women  contacted  through  want-ads  placed  in  local  newspapers.   Qualifica- 
tions considered  in  selecting  interviewers  included: 

(1)  Age  -  between  30  and  U5  years,  although  some  persons  outside 
this  age  range  were  employed. 

(2)  Household  status  -  housewives  were  preferred.   However,  other 
women  with  housekeeping  experience  were  considered  for  employment. 

(3)  Education  -  2  to  U  years  of  college  desired. 

(U)  Experience  -  interviewing  experience  was  desirable,  especially 
if  it  included  census  enumeration  or  work  on  surveys  using  a 
probability- 3 ample  design.   Social  workers  were  accepted  but 
not  persons  whose  experience  was  chiefly  in  the  field  of  house- 
to-house  selling. 

(5)  Family  responsibility  -  no  interviewers  with  children  under 
the  age  of  5  were  selected  unless  adequate  provision  could  be 
made  for  their  care  both  during  the  day  aind  evening. 

(6)  Car  owners  -  interviewers  were  selected  who  could  use  their  own 
cars  in  their  work. 

(7)  Availability  -  it  was  stipulated  that  interviewers  must  be  able 
to  work  evenings  and  week-ends  and  a  mirJjnum  of  30  hours  a  week. 

(8)  Other  work  -  only  interviewers  whose  only  employment  outside 
the  home  was  that  of  part-time  interviewing  were  accepted. 

It  was  considered  necessary  that  each  interviewer  live  in  the  primary 
sampling  unit  in  which  she  was  to  work  oecause  of  the  frequent  contacts 
required  with  many  of  the  households.   In  the  South,  Negro  intei^ewers 
were  employed  to  make  calls  at  sample  dwelling  units  occupied  by  Negroes. 
These  interviewers  were  not  required  to  have  cars.  AutomcDile  transporta- 
tion was  provided,  if  necessary. 

Training  of  Interviewers 

Training  of  field  interviewers  consisted  of  an  educational  program 
conducted  by  mail,  followed  by  a  day  of  personal  counsel  and  coaching  by 
a  staff  supervisor. 

3/  All  sample  counties  in  the  second  subuni verse  are  also  in  the  company's 
National  Retail  Store  Audit  Sample,  whereas  only  part  of  the  sample  counties 
in  the  first  subuni  verse  are  in  the  Store  Audit  Sainple. 
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As  pai-t  cf  the  training  program  each  field  worker  was  required,  first 
to  keep  a  diary  for  her  own  family  for  h   weeks  and  to  perform  all  of  the  ' 
tasks  expected  of  a  regular  panel  member.  These  diaries  were  edited  and 
the  inten-iewers  were  advised  in  detailed  letters  of  any  mistakes  that 
were  found.  Thus,  each  interviewer  learned  exactly  what  was  expected  of 
a  panel  member.   She  learned  also  that  the  task  of  keeping  a  diary  becomes 
simpler  and  less  time-consuming  after  a  few  weeks'  experience. 

A  comprehensive  interviewers'  instruction  manual,  which  anticipated 
the  field  problems  that  would  be  encountered,  was  prepared  and  sent  to 
interviewers  for  concentrated  study,  bach  interviewer  was  required  to 
master  the  instructions  and  to  pass  a  quiz  which  required  complete  knowl- 
edge of  all  essential  points  in  the  manual.  The  quizzes  were  reviewed  in 
the  office  of  the  company  and  an  individual  letter  was  written  to  each 
interviewer  indicating  any  points  that  she  should  study  further. 

With  the  exception  of  a  few  who  had  to  be  replaced,  all  interviewers 
were  then  instructed  to  list  the  dwellings  in  sample  blocks  and  to  select 
sapiple  dwelling  units.  When  this  work  was  completed  the  interviewers  were 
expected  to  practice  "recruiting"  a  friend  or  relative  and  to  try  to  recruit 
not  more  than  two  sample  households. 

At  this  point  a  staff  supervisor  visited  each  field  interviewer  to : 
(1)  Create  enthusiasm  for  the  difficult  part  of  the  assignment,  the  actual 
recruiting;  (2)  review  the  listing  and  selection  of  dwelling  units; 
(3)  ascertain  how  well  the  interviewer  understood  the  job  ahead;  and  {k)   dis- 
cuss any  questions  concerning  the  project  or  problems  that  might  be 
encountered.  The  visit  included  a  simulated  interview,  wherein  the  inter- 
viewer played  her  own  role  as  an  interviewer  and  the  supervisor  the  role 
of  a  housewife. 

In  retrospect,  the  company  is  satisfied  that,  because  of  the  unusual 
nature  of  the  field  work  involved,  the  mail  training  program  was  better 
than  the  classroom  or  meeting  type  of  training.  The  reasons  for  this 
opinion  are: 

(1)  Some  high-quality  personnel  accepted  the  assignment  and  executed 
it  with  a  high  degree  of  efficiency,  but  if  they  had  had  to  travel  to  a 
central  location  for  several  days  for  classroom  instruction,  they  would  have 
refused  the  assignment.  This  was  true  of  some  of  the  housewives  who  had 
oart-time  ooligations  in  the  home.   It  was  particularly  true  of  some  of  the 
Negro  interviewers  in  the  large  cities  and  in  the  South,  many  of  whom  are 
the  wives  of  college  professors  and  who  themselves  hold  advanced  degrees. 

(2)  The  first  step  in  the  mail  training  program  involved  keeping  the 
diary.  This  gave  the  interviewer  a  knowledge  through  experience  that  she 
would  probably  not  have  gotten  in  classroom  lectures  or  discussions. 

(3)  The  training  program  was  personalized  for  each  interviewer. 
Emphasis  was  placed  on  problems  she  would  be  likely  to  meet  in  the  type  of 
area  in  which  she  was  to  work.  The  problems  in  large  cities  vary  greatly 
from  those  in  small  towns  and  rural  areas.   Classroom  training  would  have 
been  more  general  than  the  individual  tutoring  each  interviewer  received. 
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(U)  By  visiting  each  interviewer  at  her  home,  a  personal  loyalty  was 
developed  that  could  not  have  been  accomplished  by  group  training.  A 
minimum  of  one  day  devoted  exclusively  to  an  individual  inter^'/iewer  developed 
a  degree  of  friendship  and  cooperation  that  would  t>e  difficult  to  obtain 
by  any  other  system. 

(5)  If  an  interviewer  must  learn  the  instructions  from  a  manual,  she 
is  likely  to  rely  upon  it  as  a  reference  in  solving  questions  that  arise 
rather  than  to  contact  the  supervisor  or  to  assume  an  answer. 

Although  the  group  training  program  followed  in  the  New  York  Metropol- 
itan area—  was  reasonably  successful,  the  personalized  mail  tradning  program 
seems  to  be  better.  All  fie],d  interviewers  currently  employed  are  trained 
on  this  basis  rather  than  by  classroom  techniques.  This  is  true  even  in 
large  cities  where  several  interviewers  are  needed. 

Hecruitlng  and  Training  of  Households 

Interviewers  were  provided  with  special  forms  on  which  to  record 
certain  information  concerning  each  call  that  was  made  and  on  which  to 
account  in  detail  for  all  time  and  travel.   One  form  was  designed  for  re- 
porting details  of  time  and  travel  by  calls  made.  Three  other  forms  were 
intended  for  use  in  reporting;  results  of  calls  made,  one  for  each  of  three 
types  of  calls,  as  follows: 

A  no-interview  call  —  any  call  on  which  the  interviewer  did  not  succeed 
in  obtaining  an  interview  with  the  homemaker,  either  because  she  was  not  at 
home  or  was  not  available  for  an  interview.   Interviewers  were  instructed 
to  make  no  more  than  three  no-interview  calls  in  an  effort  to  oDtain  a  first 
interview  with  the  household,  although  additional  calls  co'Old  De  made  if 
the  interviewer  was  near  enough  to  call  back  with  the  expenditure  of  only 
a  small  amo'jnt  of  additional  time  and  travel, 

A  recruiting  call  —  one  during  which  the  interviewer  had  an  opportunity 
to  discuss  panel  membership  with  the  monitor,  the  person  who  would  keep  the 
diary.   Usually,  the  monitor  is  the  person  who  buys  most  of  the  family's 
food.  Often  an  agreement  to  join  the  panel  was  obtained  during  the  first 
recruiting  call,  but  ordinarily  if  cooperation  was  not  ootained  in  two  re- 
cruiting calls,  no  further  effort  was  made  to  enlist  the  household.   However, 
the  interviewer  was  expected  to  us---  discretion  in  making  additional  calls  on 
those  households  where  further  calls  appeared  to  De  justified. 

A  training  call  —  one  made  to  instruct  the  housewife  in  panel  memoer- 
ship  and  in  keeping  the  weekly  purchase  diary.   Instruction  of  a  training 
nature  was  frequently  given  during  the  recruiting  call  when  the  household 
agreed  to  join  the  panel.  A  call  was  not  classified  as  a  training  call  unless 
it  was  a  call  for  training  purposes  subsequent  to  the  call  during  which  the 
household  agreed  to  join  the  panel.  For  purposes  of  this  report,  any  training 
call  made  to  a  household  that  was  eventually  classed  as  a  refusal,  that  is, 
one  that  never  submitted  a  diary,  was  reclassified  as  a  recruiting  call. 


\x/   See  footnote  1,  p.  U. 
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The  interviewer's  reports  of  individual  calls  were  used  as  a  guide  in 
the  preparation  of  special  letters  to  the  housoholds,  in  formulating  instruc- 
tions to  interviewers,  and  as  the  basis  for  part  of  the  discussion  presented 
later  in  this  report. 

For  participation  in  the  panel  the  households  were  remunerated  in  points 
that  could  be  exchanged  for  merchandise.  The  point  system  is  outlined  in 
the  accompanying  tabulation. 

Premium  Points 

For  joining 300 

For  each  weekly  diary  sucanitted  ....    1/      5 

Extra  points  for  each  household 

member  who  initials  the  diary  ,  ,  ,  ,    2/      $ 

Weekly  bonus  for  prompt  mailing 

of  diary 1/     15 

Monthly  bonus  for  prompt  mailing 

of  all  diaries  during  month 3/     60 

Quarterly  bonus  for  prompt  mailing 
of  all  diaries  during  a  calendar 
quarter   3/    250 

1/  Increased  by  an  additional  5  points  in  June  of  1951. 

?/  Each  member  of  the  household  is  requested  to  check 
the  diary  for  completeness  and  accuracy  of  purchase  informa- 
tion and  to  initial  the  diary  in  the  space  provided, 

3/  A  household  joining  the  panel  during  the  period  was 
credited  with  these  bonus  points  if  all  diaries  for  the 
remainder  of  the  period  were  mailed  promptly. 

Premium  points  earned  in  accordance  with  this  schedule  were  credited  to 
the  account  of  the  household  in  records  kept  by  the  company.  Each  panel 
member  was  provided  with  an  illustrated  catalog  of  items  obtainable  for  points 
and  was  permitted  to  order  at  any  time  within  the  limits  of  the  premium-point 
balance.  The  value  of  a  premium  point  in  terms  of  wholesale  prices  is 
approximately  one-half  cent. 

Training  of  households  joining  the  panel  was  carried  on  both  in  the 
field  and  from  the  office.  This  training  usually  began  on  the  recruiting  call 
during  which  the  household  agreed  to  keep  the  weekly  diary  if  circumstances 
permitted.  Otherwise,  an  ^pointment  was  made  for  that  purpose.  The 
interviewer  went  over  the  diary  in  some  detail,  explaining  the  information  to 
be  recorded,  illustrating  how  the  record  should  be  kept,  and  demonstrating 
by  recently  purchased  items.   Four  diaries  bearing  the  name,  address,  and 
household  serial  number  were  left  with  the  respondent  during  this  interview. 
Also,  an  appointment  was  made  to  return  a  week  later  to  review  the  first 
diary  kept  and  to  discuss  any  questions  concerning  the  keeping  of  the  diary 
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or  other  matters  of  panel  membership.  If  after  reviewing  the  first  diary 
the  interviewer  thought  additional  training  was  needed,  an  appointment  was 
made  to  return  a  week  later. 

Training  from  the  office  began  with  receipt  from  the  interviewer  of 
the  "Report  of  Recruited  Family."  A  letter  of  acknowledgment  was  sent  to 
the  household  welcoming  it  to  panel  membership.   A  file  was  set  up  in  the 
control  system  for  recording  information  on  diaries  received.  This  informa- 
tion included  date  of  postmark  and  number  of  persons  who  initialed  the  diaiT^, 
because  the  numoer  of  points  to  be  credited  to  the  household  depended  on 
these  factors. 

The  first  two  diaries  received  were  considered  training-call  diaries, 
many  of  which  had  been  reviewed  by  the  interviewer  in  the  field.  The  office 
review  of  diaries  began  with  the  third  diary  received. 

Diaries  suoraitted  during  the  training  period  were  reviewed  ajid  coded, 
but  were  not  included  in  tabulations.   A  special  form,  the  "Diary  Review," 
was  used  to  call  attention  to  errors  or  questionable  entries  and  to  make 
suggestions  to  the  monitor.   This  form  was  prepared  for  each  diaiy  in  which 
deficiencies  were  found.   In  addition,  a  set  of  informative  letters, 
designed  to  be  sent  out  in  sequence,  was  prepared.   The  set  covered  various 
phases  of  diaiy  keeping.  These  form  letters  were  not  mailed  at  predetermined 
intervals,  but  were  sent  one  at  a  time  to  the  households  along  with  the 
diary  re'/iew.   If  after  the  fo'or   form  letters  had  been  sent,  further  corres- 
pondence was  considered  necessary,  a  special  covering  letter  was  sent  along 
with  the  diary-review  form. 

A  weekly  check  was  made  of  all  households  in  training.   If  the  diary 
for  the  previous  week  had  not  been  received,  an  indi\'ldually  typed  letter 
was  sent  indicating  concern  over  the  missing  diary  and  expressing  hope  that 
the  prompt  sut«nission  of  diaries  would  be  resumed.  Three  such  letters  were 
sent  if  necessary.  With  the  third  letter  a  reply  card  was  enclosed  for  use 
in  indicating  whether  there  was  any  intention  of  resuming  the  sending  in  of 
diaries.   If  the  card  was  returned  indicating  a  desire  to  "oe  dropped,  or 
if  no  reply  was  received  either  by  return  of  the  card,  a  letter,  or  the  sub- 
mission of  a  diary,  the  household  was  dropped.  A  letter  was  sent  stating 
the  household's  premium-point  balance  and  indicating  that  with  reluctance 
and  regret  it  was  being  dropped  from  the  panel. 

The  diaries  and  the  record  of  diaries  received  were  reviewed  for  such 
cases  as  irregular  or  intermittent  reporters,  late  diaries,  early  diaries, 
and  an  overabundance  of  blank  diaries,  \-ihen   considered  advisable,  a  letter 
was  sent  pointing  out  the  importance  of  receiving  a  diary  on  time  each 
week  covering  the  entire  week  and  calling  attention  to  the  loss  of  premium 
points  that  would  result  from  late  or  missing  diaries. 

Diaries  were  mailed  to  households  once  a  month.  The  first  group  of 
diaries  sent  to  a  household  was  accompanied  by  a  training  letter  and  a 
reference  sheet  explaining  such  matters  as  how  premium  points  are  earned, 
the  importance  of  the  household  serial  number,  the  importance  of  having  each 


. 
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diary  cover  purchases  in  only  one  calendar  week,  and  other  matters.  The 
second  and  subsequent  groups  of  diaries  were  accompanied  by  the  regular 
monthly  diary  transmittal  letter  which  differed  each  month. 

After  cooperators  had  been  in  training  2  to  3  months,  their  records 
were  re\TLev/ed  to  seltjct  the  households  that  appeared  to  need  no  further 
training  and  were  ready  to  have  their  diaries  included  in  the  recular 
tabulations. 

Maintenance  after  Transfer  to  Tabulation 

At  the  end  of  each  month  the  reporting  records  were  reviewed  for  late 
and  missing  disjues.   If  as  many  as  three  diaries  were  missing  in  the 
returns  of  a  cooperator  during  the  month,  a  letter  was  written  and  a  reply 
card  enclosed.   At  the  end  of  the  following  month,  if  no  reply  had  been 
received  either  by  return  of  the  reply  card,  a  letter,  or  the  submission  of 
diaries,  or  if  a  reply  was  received  indicating  that  the  household  wished  to 
be  dropped  from  the  panel,  it  was  dropped. 

If  as  mai\^    as  tvro  diaries  were  sent  in  late  during  the  month,  a  letter 
was  writte2i  pointing  out  the  loss  of  premium,  points  resulting  from  late 
diaries  and  also  the  importance  to  the  company  of  receiving  the  diaries 
on  time. 

Once  in  3  months  the  reporting  records  were  checked  and  a  letter  was 
sent  to  households  from  whose  records  one  or  two  diaries  were  missing  each 
month.   If  the  intermittent  reporting  continued  the  household  may  have  been 
dropped  from  the  panel.   An  effort  was  made  to  retain  as  many  of  the 
originally  selected  probability  households  as  possible  rather  than  to  replace 
them  with  substitutes. 

If  a  review  and  coding  of  a  diary  showed  that  it  contained  deficiencies 
that  indicated  a  need  for  a  letter  to  the  household,  it  was  referred  to  the 
Family  Relations  Unit  for  preparation  of  such  a  letter.   For  errors  or 
omission  of  infonaation  from  the  diary,  a  special  write-back  form  was  used 
that  provided  for  entering  the  purchase  information  as  it  appeared  in  the 
diary  and  noting  the  questionable  or  missing  information.  The  household 
then  entered  the  additional  or  corrected  information  on  the  same  form  and 
returned  it.   Problems  that  occurred  rather  generally  were  covered  in  the 
monthly  diary  transmittal  letter. 

This  transmittal  letter,  which  was  prepared  each  month,  explained  the 
current  point  balance  and  included  new  information  of  interest  to  the  family. 
When  new  groups  of  products  were  added  or  other  changes  made  in  the  diaiy, 
a  special  instruction  sheet  was  enclosed. 
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Procedures  Used  in  Making  Substitutions 

Recruiting  of  suDstitutes  was  begun  in  Septenber  1951  -  about  U   months 
after  the  last  recruiting  efforts  were  made  sinong  the  originally  selected 
dwelling  units. 

Instructions  to  interviewers  covering  the  original  recruiting  effort 
did  not  mention  that  substitution  was  contemplated  for  households  not 
cooperating.   A  separate  instruction  manual  was  prepared  covering  the  pro- 
cedures to  be  followed  in  making  substitutions. 

The  general  plan  was  to  enlist  a  household  as  a  substitute  for  each  of 
the  probability-selected  households  not  then  in  the  panel.  In  four  cases 
a  different  type  of  treatment  was  used: 

Households  not  contacted.  —  Sample  households  that  were  not  contacted 
during  the  original  recruiting  effort  were  called  on  in  an  attempt  to  enlist 
them  as  panel  members.   If  the  intervdewer  was  unsuccessful,  either  because 
the  household  refused  or  because  no  one  was  at  home,  the  interviewer  was 
instructed  to  recruit  a  substitute  for  this  household. 

Vacant  dwelling  units.  —  The  intervievjer  was  instinicted  to  visit  the 
dwelling  units  that  were  found  vacant  in  the  original  recruiting  effort. 
If  one  was  occupied,  efforts  were  made  to  enlist  the  household;  if  thJ.s 
effort  was  not  successful,  a  substitute  household  was  recruited.   If  a  dwell- 
ing unit  was  still  vacant,  this  fact  was  noted  for  future  reference  and  no 
effort  was  made  to  find  a  cooperator  elsewhere. 

Households  that  were  ineligible  or  that  were  not  cooperating.  --  Efforts 
were  made  to  obtain  substitutes  for  all  sample  households  that  were  either 
ineligible,  had  declined  to  join  the  panel  or,  having  joined,  later  had 
discontinued  submitting  weekly  diaries  and  were  dropped. 

Households  moved  from  sample  dwelling  units.  —  A  household  recruited 
while  residing  in  a  sample  dwelling  unit  was  retained  in  the  panel  as  long 
as  satisfactory"  cooperation  continued  even  though  it  had  moved  to  a  different 
dwelling  unit.  When  such  households  discontinued  panel  membership,  efforts 
were  made  to  enlist  the  household  currently  occupying  the  originally  selected 
dwelling  unit,  or  to  find  a  substitute  when  necessary. 

The  procedures  followed  in  making  substitutions  provided  for  enlisting 
the  first  eligible  household  that  would  cooperate,  proceeding  around  the 
segment  or  block  in  a  clockwise  direction  from  the  original  sample  address. 
To  be  eligible  as  a  substitute,  the  household  must  have  oeen  in  the  sairie 
household  size  group  as  the  household  in  the  dwelling  unit  originally  selected. 

If  a  substitute  was  not  recruited  within  the  same  block  or  segment,  the 
interviewer  proceeded  to  an  adjoining  block.   In  canvassing  for  substitutes, 
the  interviewer  was  instructed  not  to  call  back  where  (1)  no  one  was  home, 
(2)  a  suitable  respondent  was  unavailable,  (3)  the  dwelling  was  vacant, 
{h)    a  refusal  was  obtained,  or  (5)  the  household  was  ineligible.   Instead, 
the  canvass  was  continued  until  a  suDstitute  was  enlisted. 
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RiSULTS  OF  THE  RECRUITING  EFFORT 

The  method  followed  in  obtaining  the  cooperation  of  the  households 
selected  within  the  framework  of  the  probability  sample  design  has  been 
described.  Table  1  provides  a  general  picture  of  the  overall  results  of 
the  recruiting  effort  by  household  status  and  geographic  areas.   In  order 
that  the  meaning  of  the  terms  "household  status"  and  "geographic  area"  may 
be  clear,  an  outline  description  of  the  categories  under  these  terms  is 
presented. 

Household  Status 

1.  Never  Called  On  -  No  effort  was  made  to  contact  households  in  this 
group  prior  to  the  date  used  for  summarizing  the  results.   (Note:  Calls 
were  made  subsequently  at  most  of  these  households.) 

2.  Ineligible  -  A  household  was  determined  to  be  ineligible  if  no 
meals  were  prepared  in  it. 

3.  Vacant  -  A  temporarily  unoccupied  dwelling  unit, 

k.     Not  Contacted  -  This  group  was  made  up  of  households  that  received 
one  or  more  no -interview  calls,  but  no  call  during  which  membership  in  the 
panel  was  discussed. 

5.  Refusal  -  A  refusal  household  was  one  that  either  refused  to  join 
the  panel  outright  or  agreed  to  join  but  submitted  no  diaries. 

6.  Enlisbed  Household  -  One  that  agreed  to  join  the  panel  and  sub- 
mitted one  or  more  diaries, 

(a)  Never  In  to  Tabulation  -  An  enlisted  household  that 
dropped  from  the  panel  during  thiS  training  period,  before 
its  diaries  were  used  in  the  tabulation  of  data, 

(b)  In  Tabulation  but  Not  Reporting  -  Households  that  sent 
in  no  diaries  during  one  or  more  of  the  three  successive 
Ii-week  periods  following  transfer  to  tabulation. 

(c)  Reporting  -  Households  that  submitted  one  or  more  diaries 
during  each  of  the  three  l^-week  periods  following  transfer 

to  tabulation. 

Geographic  Areas 

1.  Metropolitan  Areas  -  This  includes  all  households  located  within   ^ / 
the  limits  of  any  of  23  standard  metropolitan  areas  in  the  first  subuniverse-. 

^/  See  page  5. 
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2.  Nonmetropolitan  Areas  -  The  comnunity-size  and  regional  divisions 
of  the  data  in  this  report  exclude  all  households  located  in  the  first 
subuniverse.  This  practice  was  followed  primarily  because  the  proportion 
of  the  population  in  the  first  subuniverse  vaided  considerably  oy  regions. 

(a)  Community  Size, 

Urban  Place  -  Same  as  1950  Census  definition  of  urban 
except  that  it  applies  only  to  the  second  subuniverse. 

Rural  Place  -  Same  as  1950  Census  dsfinition  of  rural 
territory  except  for  the  exclusion  of  "open  country." 

Open  Country  -  Approximately,  open  country  includes  all 
households  located  outside  populated  places  having  a 
population  of  more  than  around  100  inhabitants. 

(b)  Geographic  Regions, 

North  -  North  Central,  New  England,  and  Middle  Atlantic 
States  plus  Maryland  and  Delaware. 

South  -  South  Atlantic  States  except  Maryland  sind 
Delaware,  bast  South  Central  States,  and 
Louisiana  and  iirkansas, 

VJest  -  Mountain  and  Pacific  States,  plus  Texas  and 
Oklah.oma. 

The  direction  of  differences  in  rates  of  cooperation,  shown  in  table  1, 
was  about  as  expected.   In  terms  of  households  reporting,  the  highest  rate 
of  cooperation,  Ii6  percent,  occurred  in  the  open  country  and  the  lowest, 
28  percent,  was  for  the  metropolitan  areas.   Not  only  were  the  rates  of 
cooperation  lowest  in  the  metropolitan  areas  but  the  households  there  were 
more  difficult  to  contact,  as  partly  indicated  by  the  percentage  of  noncon- 
tacted  households.   However,  a  greater  proportion  of  households  not  called 
on  were  in  the  open  country. 

Households  in  51  percent  of  the  1,120  original  sample  dwellings  were 
enlisted  in  the  panel,  out  of  these  only  70  percent  were  classified  as 
"reporting"  under  the  definition  set  forth  earlier.  Thus,  households  in 
35  percent  of  the  dwelling  units  actually  provided  purchase  data  for  the 
consumer  panel.  The  base  for  these  percentages  is  all  dwelling  units 
selected  for  the  sample.   In  terros  of  eligible  households  contacted,  5U 
percent  of  the  households  in  the  open  country  were  reporters,  32  percent 
in  metropolitan  areas  were  reporters,  and  the  overall  average  was  kO   percent. 

A  frequency  distribution  of  the  number  of  no-interview  calls  oefore  the 
first  recruiting  call  is  shown  in  table  2,  The  results  are  typical  in  that 
about  70  percent  of  the  open-country  households  were  contacted  on  the  first 
call,  vrt^.ereas  in  metropolitan  areas  the  percentage  contacted  on  the  first 
call  was  less  than  50.  Table  2  does  not  include  any  no-interview  calls  made 
after  the  first  recruiting  call  but  it  aoes  include  no-interview  calls  made 
at  households  never  contacted. 
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The  overall  average  number  of  no-interview  calls  per  recruitinf;  caU 
was  U.33  (taole  j).   The  table  shows  that  city-size  groups  dilTered 'with 
respect  to  the  difficulty  of  finding  households  at  home.   It  shows  also 
that  the  households  that  became  reporting  panel  members  required  only  auout 
two-thirds  as  man^^  no-interview  calls  per  recruiting  call  as  the  households 
that  refused  to  cooperate,  but  this  might  be  due  primarily  to  the  fact  that 
the  larger  cities  had  the  highest  refiasal  rates  and  households  in  large 
cities  are  more  difficult  to  contact.  Table  3  records  all  recruiting  calls 
not  just  the  first  recruiting  calls.  * 

Results  of  tabulations  not  shown  in  anj--  of  the  tables  gave  0.92  ca   the 
average  number  of  no-interview  calls  precedi.ng  the  first  recruiting  call 
and  0.51  as  the  average  for  recruiting  calls  after  the  first.  This  is 
mainly  because  (1)  the  interviexver  was  better  able  to  judge  when  the  poten- 
tial cooperator  would  be  home,  and  (2)  the  second  recruiting  call  was 
usually  made  by  appointment.   As  might  be  expected,  evidence  pointed  to  the 
fact  that  appointments  for  interviews  were  more  frequently  broken  by  house- 
holds that  eventually  refused  than  by  households  that  were  recruited. 

Of  the  575  households  that  cooperated  to  the  extent  of  sending  in  one 
or  more  diaries,  523,  or  90  percent,  were  enlisted  on  the  first  recruiting 
call.  Hence,  the  number  of  observations  was  not  sufficient  to  permit 
tabulating  the  data  by  the  recruiting  call  on  which  the  houseliolds  were 
enlisted.  The  results  of  the  first  recruiting  call  are  given  in  table  U 
by  area  and  by  number  of  no-intervlew  calls  that  preceded  the  first  recruiting 
call.  On  the  first  recruiting  call,  for  22  percent,  or  209  of  the  households 
receiving  a  recruiting  call,  the  outcome  was  "no  decision."  As  a  result  of 
further  efforts  to  enlist  these  209  households,  only  25  percent  joined  the 
panel  as  compared  to  5U  percent  for  the  first  recruiting  call.  There  was 
a  relationship  between  the  degree  of  cooperation  obtained  and  the  number  of 
calls  required  to  make  contact.  The  greater  the  number  of  calls,  the  smaller 
was  the  likelihood  of  the  household  cooperating  and  the  greater  the  likeli- 
hood that  it  would  discontinue  cooperation  if  it  joined  the  panel. 

Greater  cooperativeness  on  the  part  of  households  in  the  open  country 
is  reflected  in  performance  after  joining  the  panel  as  well  as  in  the  initial 
cooperation  rates — 35   percent  of  the  households  that  joined  the  panel  in  the 
metropolitan  areas  discontinued  cooperation  as  compared  to  2^  percent  of 
those  in  the  open  country. 

RESULTS  OF  THE  TRAINING  EFFORT 

An  Interviewer's  call  frequently  took  the  form  of  both  a  recruiting  and 
a  training  call.   In  most  instances,  the  latter  part  of  the  recruiting 
interview  after  the  household  has  agreed  to  cooperate,  was  used  for  training 
purposes.   The  early  part  of  an  intended  training  interview  ma^-  have  been 
spent  in  reinforcing  the  decision  by  the  household  to  join  the  panel.  It  is 
difficult  to  break  an  actual  interview  into  its  component  parts;  for  that 
reason  interviews  discussed  in  this  report  were  classified  in  accordance  with 
the  major  intended  objective  in  making  the  interview  calls. 
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A  household  was  not  classified  as  "enlisted"  unless  it  sent  in  one  or 
more  diaries.   Households  that  agreed  to  join  but  never  sutxnitted  a  diary- 
numbered  113.   A  total  of  12[i  calls  intended  for  training  were  made  on 
these  households,  which,  for  the  purposes  of  this  report,  were  reclassified 
as  recruiting  calls.  Although  the  original  objective  of  these  calls  was  to 
train  the  households  contacted,  the  interviewers  fo'ond  it  necessary  to 
redirect  their  efforts  toward  recruiting. 

Recruiting  of  households  was  in  the  hands  of  the  interxdewers,  whereas 
the  trcdning  calls  made  on  a  sample  household  comprised  only  a  part  of  the 
total  training  effort.  An  explanation  has  already  been  given  of  the  train- 
ing material  received  by   the  enlisted  households  directly  from  the  company's 
Chicago  office.  Hence,  this  section  is  limited  to  a  discussion  of  the 
training  calls  carried  out  xn  the  field  by  the  interviewers. 

A  substantial  number  of  enlisted  households  received  no  training  calls 
for  the  reason  that  they  received  sufficient  training  during  the  recruiting 
calls.  Although  interviewers  were  instructed  to  make  no  more  than  two 
training  calls  on  any  one  household,  they  were  permitted  to  exercise  their 
discretion  to  some  extent.   Thus,  the  number  of  training  calls  to  be  made 
on  each  household  was  left  to  the  interviewer's  judgment.   In  some  instances, 
further  training  calls  were  dispensed  with  at  the  insistence  of  the  monitor, 
that  is,  the  person  responsible  for  keeping  the  diary. 

Geographically,  the  amount  of  training  carried  out  by  the  interviewers 
was  rather  uniform  (table  5).  The  main  difference  was  between  the  training 
in  the  North  and  that  in  the  South.  About  a  third  more  training  calls  per 
household  were  made  in  the  South  than  in  the  North.  Households  that  dis- 
continued cooperation  after  being  recruited  received  about  a  fourth  more 
training  calls  than  households  that  reached  reportirig  status. 

It  was  expected  that  little  difficulty  would  be  encountered  in  con- 
tacting enlisted  households  for  training  calls  (table  6).  These  households 
had  already  demonstrated  their  willingness  to  cooperate  ay   agreeing  to  join 
the  panel,  and  all  trairJ.ng  calls  were  scheduled  with  the  monitor  by  appoint- 
ment. Actually,  in  about  a  fifth  of  the  cases,  it  was  not  necessary  to 
make  calls  for  the  purpose  of  training.   Households  that  attained  reporting 
status  were  easiest  to  contact  for  training. 

Of  vital  importance  to  the  operation  of  a  consumer  panel  is  the  consist- 
ency of  reporting.   A  conq?osite  picture  of  how  well  the  households  reported 
during  the  first  2k   weeks  after  completion  of  the  training  period  is 
presented  in  table  7.  The  six  successive  li-week  periods  shown  here  are  not 
related  to  identical  time  periods.  As  diaries  for  recruited  households 
began  being  used  in  tabulation  at  various  times,  the  measurement  of  reporting 
performance  for  each  household  begins  with  the  date  when  the  diaries  were 
used  for  tabulation. 

The  reporting  performance  of  the  households  in  tabulation  was  quite 
consistent.   During  each  of  the  six  periods,  80  percent  of  the  active  house- 
holds in  the  sample  {kSS   households  transferred  to  tabulation  minus  those 
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that  dropped  from  the  panel)  submitted  a  diary  each  week.  Apparently,  when 
households  no  longer  wish  to  continue  in  the  panel,  their  reporting  per- 
formance fails  rather  abruptly.  This  is  indicated  by  the  fact  that  tho  two 
largest  groups  in  each  period  are  the  households  that  mail  in  all  four 
diaries  and  those  that  return  no  diaries.   Of  the  households  transferred 
to  tabulation,  Si   (10  percent)  were  dropped  from  the  panel  within  21j  weoka 
after  they  were  transferred, 

ANALYSIS  OF  FIELD  COSTS 

How  much  effort  should  be  spent  in  trying  to  obtain  the  cooperation  of 
specified  sample  families?  This  question  should  be  viewed  in  terms  of  costs 
and  returns  for  additional  increments  of  input.  An  attempt  has  been  made  to 
break  the  total  actual  field  costs  of  recruiting  into  two  parts:   (1)  The 
cost  that  would  have  been  incurred  if  no  calls  beyond  the  first  recruiting 
call  had  been  made  and  (2)  the  added  cost  of  making  recruiting  calls  beyond 
the  first  recruiting  call.  Remember,  in  reading  the  remainder  of  this 
section,  the  definition  of  a  recruiting  call  (see  page  8). 

The  direct  field  costs  of  salaries  and  expenses  for  interviewers  while 
recruiting  are  shown  in  the  first  three  lines  of  table  6.   Costs  not 
included  are  those  for  (1)  employing  and  training  interviewers,  (2)  salaries 
and  expenses  paid  interviewers  for  listing  the  dwelling  units  in  sample 
areas,  (3)  salaries  and  expenses  of  interviewers  while  training  households, 
(h)   training  recruited  households  by  mail  from  the  company's  Chicago  office, 
(5)  salaries  and  expenses  of  any  office  personnel  who  worked  on  the  project, 
and  (6)  salaries  and  expenses  of  staff  svipervisors  while  on  field  trips  to 
supervise  interviewers. 

It  is  recognized  that  the  costs  presented  in  table  8  might  not  reflect 
exactly  what  was  intended  because  first  and  second  recruiting  calls  and 
training  calls  may  all  be  made  in  the  course  of  a  day's  work.   From  the 
records  a  cost  was  assigned  to  each  call.  The  cost  associated  with  the  first 
recruiting  call  includes  all  first  recruiting  calls,  all  no-interview  calls 
pertaining  to  the  first  recruiting  calls,  and  all  atten^jts  to  contact  the 
155  dwellings  that  did  not  receive  a  recruiting  call.  This  cost  is  an 
estimate  of  what  the  cost  would  have  been  if  the  instructions  to  interviewers 
had  been  the  same  except  that  no  recruiting  calls  beyond  the  first  would  be 
made. 

The  cost  of  the  second  and  later  recruiting  calls  is  the  estimated 
added  cost  of  making  return  visits  to  those  households  that  on  first  call 
gave  no  decision.  Although  the  cost  per  recniiting  call  is  less  for  recruit- 
ing calls  after  the  first,  the  cost  per  household  reaching  reporting  status 
is  considerably  higher  because  of  poor  cooperation  of  the  households  that 
were  contacted  a  second  time.  On  the  first  recruiting  "round,"  37  percent 
of  the  contacts  resulted  in  reporting  households.  For  the  second  and  later 
calls  the  yield  was  only  13  percent.  One  way  to  eliminate  the  necessity  of 
a  second  call  would  be  to  press  for  a  "yes-no"  decision  on  the  first 
recruiting  call.  Sufficient  information  is  not  available  to  permit  a  full 
evaluation.  Pressing  for  a  "yes-no"  decision  on  the  first  recruiting  call 
might  be  better  considering  cost  and  accuracy. 

The  last  line  of  table  8  summarizes  the  total  direct  field  costs 
involved  in  recruiting,  training,  and  no-interview  calls. 
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HOUSEHOLD  CHAR/.CTERISTICS  BY  STATUS  OF  HOUSEHOLD 

Information  available  on  bias  resulting  from  noncooperation  is  limited 
to  a  number  of  household  characteristics  that  might  be  correlated  with  food 
purchases.  Household  characteristics  by  family  status  are  presented  in 
table  9.  However,  many  of  the  differences  among  the  status  groups  can  be 
attributed  to  sampling  variability. 

The  census  data  included  in  table  9  are  taken  from  a  number  of  publica- 
tions and  aire  estimates  for  the  United  States  based  upon  samples;  whereas 
the  panel  sample  is  for  the  United  States,  excluding  the  New  York  metro- 
politan area.  With  the  exception  of  race,  no  information  was  available  on 
household  characteristics  for  a  third  to  a  half  of  the  households  that 
refused  to  participate  in  the  panel.  For  this  reason  part  of  the  compari- 
sons shown  in  table  9  are  of  questionable  value,  although  information  on 
characteristics  was  available  for  practically  all  of  the  households  that 
agreed  to  join  the  panel.   In  general,  however,  the  results  are  consistent 
with  similar  comparisons  made  in  the  New  York  area  6/  as  summarized  below. 
Cooperation  is  best  among  households  having  housewives  in  the  younger  age 
groups  or  having  more  than  one  or  two  members. 

For  contrast  with  table  9,  tables  10  and  11  p)ertaining  to  the  companion 
project  in  the  New  York  Metropolitan  area  are  included.   Table  10  is  a 
reproduction  of  table  15  in  the  New  York  report  6/and  is  not  entirely 
comparable  with  table  9.  The  two  columns  in  table  9>  Recruited-Not  Report- 
ing and  Recruited  Reporting,  combined  are  comparable  to  the  column  headed 
recruited  households  in  table  10.  The  columns  headed  "refusal  households" 
are  comparable  but  the  definition  of  a  reporting  household  was  not  the  same 
in  the  two  samples.   In  the  New  York  analysis  a  household  was  defined  as 
"reporting"  if  it  was  reporting  during  February  1951,  which  was  about  a 
year  after  field  work  on  contacting  households  was  initiated.  Thus, 
"reporting  households"  in  table  10  represent  a  group  of  households  that, 
on  the  average,  had  been  reporting  for  a  longer  period  of  time  than  the 
"reporting"  households  in  table  9.   However,  the  effect  of  such  noncompara- 
bility  is  believed  to  be  negligible. 

Table  11  presents  the  characteristics  of  the  households  in  the  current 
active  sample  in  the  New  York  area  as  compared  to  the  characteristics  of 
the  households  in  the  original  probability  sample.  The  active  sample  includes 
households  that  were  in  the  original  sample,  plus  substitutes. 


6/  See  footnote  1,  page  U. 
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Table   2.-  Distribution  of  households  by  number  of  no -interview  calls 
preceding  the  first  recruiting  call  by  areas   and  by 
outcome  of  the  first  recruiting  call 


recruiting  call 


Item           ] 

Total 
house- 
holds in 

!  sample 

Number  of 

no 

-inte 

rview 

call 

s 

None 

* 

*   1 

• 
• 

• 
• 

2 

:  3  or 
:  more 

•  Total 

• 
• 

:  Number 

Percent 

Percent 

Pe 

rcent 

Percent 

Percent 

Metropolitan  

1*66 

hk 

26 

16 

11* 

100 

NonmetroDolitan  ... 

Connunity            : 
Urban : 

"    2]42 

51 

26 

17 

6 

100 

Rural ; 

132 

61 

26 

9 

h 

100 

Open  country  ... 

:    280 

69 

23 

5 

3 

100 

Region 

North  

]         282 

58 

27 

10 

5 

100 

South  

:    253 

65 

2k 

8 

3 

100 

West   : 

:    119 

57 

22 

13 

8 

100 

United  States    ...   : 

.   1,120 

5l4 

25 

13 

0 

luO 

Outcome  of  first       ! 

Enlisted  : 

I         523 

60 

27 

10 

3 

100 

Refusal  ; 

:    233 

53 

26 

15 

6 

100 

No  decision  .  .  . 

!    209 

59 

23 

12 

6 

100 

Did  not  receive  a 

recruiting  call  .   ; 

155 

27 

23 

17 

33 

100 

Table  3.-  Number  of  recruiting  calls  and  average  number  of  no-interview 
calls  per  recruiting  call,    by  specified  areas  and  household  status 


Item 


Recnaiting 
calls 


Average  number  of 
no-interview  calls 


per  recraiting  call— 


1/ 


Number 


Number 


Metropolitan   ,    , 
Nonraetropolitan 
Community 

Urban     .    ,    , 

Rural     .    .    . 

Open  country 
Region 

North  .  .  . 

South  .  .  . 

West  .... 
United  States 


5U6 


1.09 


27U 
lh9 
283 

.86 
.55 
.Uii 

321 
271 

.6U 
.51 
.8U 

l,2b2 

0.  J3 

2/ 

Household  status—'  s 

Refusals :  613  .77 

Enlisted  : 

Never  in  tabulation :  131  .67 

In  tabulation  but  not  reporting  :  67  .60 

Reporting ;  k3h ^_5l 

1/  This  includes  calls  made  on  inellgibles,   vacant  dwellings,  and  households 
never  contacted.     2/  See  page  13. 
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Table  5.-  Average  number  of  training  calls  per  household, 

by  specified  areas 


Area 


Enlisted  households 


Total 


iTraining 
House-  : calls    ; 
holds   :per      ; 

I household: 


:  Failed  to  obtain 
:  reporting  status 


Reporting 


:  Average   :        '.Average 

House-  : training  :  House-  : training 

holds  :calls  per:  holds   :calls  per 

ihousehold:        rhousehold 


Metropolitan  .  . 
Nonmetropolitan 
Community 

Urban  .  .  . 

Rural  .  .  . 

Open  country 
Region 

North  .  .  . 

South  .  .  . 

West  .... 
United  States 


Number   N'omber 


Number   Number 


Number   Na-noer 


208 


1.27 


75 


1.52 


133 


1.13 


127 

71 

169 

1.16 
1.20 
1.2U 

1*0 

1.29 

1.U6 
l.iiO 

86 

U7 

129 

1.09 
1.06 

1.19 

166 

lli3 
58 

1.05 
l.Ul 
1.12 

37 

51 

17 

1.30 
1.U5 

1.2ii 

129 
92 

.98 
1.39 

1.07 

575 

1.23 

180 

1.U5 

395 

1.13 

Table   6.-  Training  calls  and  no-interview  training  calls, 

by  household  status 


[Households 
!   enlisted 

: Training 
:   calls 

:   No-interview  training  calls 

Status 

Total  : 

Average      : Average  per 

per          :   training 
household:        call 

Failed  to  obtain 

reporting  status   .    . 

Reporting     

I     Nuiiber 

t           180 
i          39S 

Number 
259 

Number 

63 
5U 

Number 

0.35 

.lU 

Number 

0.2U 
.12 

Total  or  average   .    .    .    ' 

575 

707 

117 

.20 

.17 

5 

^ 


Table  ?.- 
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Households  reporting  after  being  transferred  to  tabulation, 
by  U-week  periods,    by  number  of  diaries   submitted 


Item 


Diaries  submitted  during  k   weeks 
None 

Households  di'opped  .... 
Households  still  in  panel 


1  diary  during  It  weeks  . 

2  diaries  during  h   weeks 

3  aiaries  during  h   weeks 
h   diaries  during  k   weeks 

Total  households  1/  . 


Households  reporting  by  U-week  periods 


5 


Nujnber  Number  Numoer  Number  Numoer  Numoer 


0 
31 

11 
6 

Uo 
36? 


7 

39 

lli 
13 

28 

3Sh 


15  25  39  51 

3ii  U3  39  U2 


15 

13 

35 

3h3 


11 
15 
28 

33} 


16 

8 
27 

326 


h 
12 

19 
327 


U55       U55       U55       hSS       hSS 


U55 


1/  Three  households  are  not  included  in  this  table.  They  were  trancf erred 
to  tabulation  at  too  late  a  date  for  a  full  2U-week  reporting  record  to  be 
available  for  them. 


Table  8.-  Field  costs  per  call,  per  household  enlisted,  per  household 
transferred  to  tabulation,  per  household  reporting, 
by  recruiting  call  number  and  all  field  work 


Item 


Cost   :      :Average 

of    :Number;  cost 
making  :  of  ;  per 
calls  : calls  ;  call 
1/ :  :  2/ 


Households  enlisted 


Total 


:  Transferred 
:to  tabulation 


.,  ,   :  Average:.,  ,   :  Average 
Number    .  ^  ,  Number    .  f , 
:cost  3/t ?_c ost  V 


Reporting 


„  : Average 

Numoer         .    5, 
cost  5/ 


Ti)        [25        U)      ~TO  (5)        (6)  (7)        (3)  (97 

Dollars  Number  Dollars  Numoer  Dollars  Number  Dollars  Number  Dollai's 


Recruiting 
1st  calls.... 

2nd  and 
later  calls 


5,665 


9Tk      5.82        523      10.83        Ul8      13.55        3S9      15.78 


Total 


1,310 

278 

U.71 

52 

25.19 

UO 

32.75 

36 

36.39 

6,975 

1,252 

5.57 

575 

12.13 

U58 

15.23 

395 

17.66 

Recruiting 
and  training, 

X/Ql/Bl,    ....... 


9,850  6/1,959      5.03        575      17.13        h58      21.51        395      2k. 9h 


1/  Includes  only  salaries  and  expenses  of  interviewers   (See  text), 

1/  Columr   (1)   divided  by  column  (2). 

3/  Colvimn  (1)   divided  by  column  (ii). 

U/  Column  (1)  divided  by  column  (6). 

5/  Column  (1)  divided  by  column  (8). 

Z/  1,252  recniiting  calls  plus  707  training  calls. 
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Table  9.-   Percentage  distribution  of  household  characteristics, 

by  status  of  household  1/ 


Household  characteristic 


Census 
2/ 


Sample  households 


Enlisted 


Total 


: Reporting 


> 


;Refusal3  :    Not  ,  /i 

: reporting—  ;   U/ 


[Percent   Percent  Percent 


Percent 


Age  of  head  of  household 

Under  35  

35  -  U^     

ii5  and  over 

Total     

Education  of  head  of  household 

Grainmar  school :  I48 

High  school :         38 

College :  lU 

Total     

Race  of  head  of  household 

White     

Nonwhite   

Total , 

Total  income  of  household 

Under  $6,000   

$6,000  and  over  .... 
Total  

Members  in  household  : 

1 :    11 

2 :    29 

3 :    22 

i^ :    18 

5  or  more :    20 

Total : 

Tenure  of  dwelling  unit  : 

Owner  occupied : 

Renter  occupied  : 

Total : 

Employment  status  of  housewife  : 

Employed  outside  home  .  .  : 

Not  employed  outside  home  : 

Total : 

Total  meals  eaten  in  : 

0-21 : 

22  -  U2 : 

U3  -  63 : 

6U  -  8U : 

85  or  more : 

Total : 


U7 
38 

15 


8 

27 
21 

20 

2I4 


5U 
3ii 
12 


13 
37 
18 

15 

17 


U6 
UO 

ih 


8 
22 
27 
16 
27 


Percent 


25 

22 

12 

28 

25 

23 

21 

19 

21 

23 

52 

57 

69 

51 

52 

100 

100 

100 

I'JC 

ICO 

36 

18 


100 

100 

10c 

IOC 

100 

91 

9 

88 

12 

90 
10 

85 

15 

89 

11 

100 

100 

100 

irx} 

IOl' 

88 

12 

82 

18 

80 
20 

80 

20 

8u 

16 

luu 

100 

100 

100 

L/,' 

3 
22 
21 
25 
29 


lOo 

100 

ICO 

100 

IOC 

57 

li3 

61 
39 

65 

35 

56 

hh 

01 

39 

100 

100 

100 

ICO 

100 

— 

20 
80 

19 

81 

19 

81 

21 

7? 

— 

100 

100 

10c 

100 

9 

16 

11 

h 

26 

3U 

22 

23 

2ii 

21 

27 

23 

19 

13 

16 

25 

22 

16 

2ii 

25 

100 


100 


100 
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Table  9.-  Percentage  distribution  of  household  characteristics, 
by  status  of  household  1/  (Continued) 


Household  characteristic 


1 

6 

11 

16 


Meals  prepared  to  go  out 
None  .  .  . 

5  . 
10  . 

15  . 

Total 

Ratio  of  total  meals  prepared 
to  total  possible 
0.00  -  0.59 
.69 
.79 
.89 
1.00 
Total 
Weekly  expenditure  for  food 

^  0  -  $15.00 

16.00  -  30.00 

31.00  -  U5.00 

146.00   -100.00 

Total      .    . 

Store  usually  patronized 
No  single  one 
An  independent 
A  chain     .    .    . 
Total     .    . 


Census 
2/ 


.60 
.70 
.80 
.90 


Sample  households 


Total 


Refusals 


Enlisted 


Percent   Percent  Percent 


Not  , /iReporting 
reporting^^;    hf 


65 

16 

12 

h 

3 


71 

lU 

9 

3 

3 


Percent 


65 

13 

lU 
6 
2 


Percent 


62 

18 

13 

h 

3 


100 


100 


I0(j 


100 


5 
5 
9 

15 
66 


6 

6 

11 
10 
67 


7 

8 
10 

Hi 

61 


3 
3 

8 

17 
69 


100 


100 


100 


10:  J 


hi 

U3 
8 
2 


h9 

Ul 

8 

2 


hi 
38 
11 

Ix 


hi 
7 

1 


100 


100 


100 


100 


6 
1x1 
hi 


8 
I18 


k 

111 


100 


Too 


100 


5 
hh 

51 

loo" 


1/  All  percentages  are  based  upon  the  total  number  of  households  in  each  category 
for  which  information  was  available. 

2/  Bureau  of  the  Census.   Compiled  as  follows:  Age,  'l^arital  Status  and  House- 
hold Characteristics"  March  1950  p.  20  #'}>3  -   Table  6;  Education,  "Educational 
Attainment  of  the  Population  25  years  and  over  for  the  United  States"  -  1950. 
PC  -  7  ^6  -  Table  1;  Race,  "Marital  Status  and  Household  Characteristics"  March 
1950.  p.  20  #33  -  Tables  7  and  9j  Income,  "Employment  and  Income  in  the  United 
States,  by  Regions"  19^9  Data.  PC  -  7  #2  -  Taole  9;  "Housing  Characteristics,  by 
Regions"  April  1,  1950.   HC  -  5  #3  -  Table  2;  Tenure,  "Sum-nary  of  Housing  Charac- 
teristics for  Selected  Standard  Metropolitan  Areas"  April  1,  1950.  HC  -  5  #U  - 
Table  2. 

3/  180  households  not  reporting, 

"h/   395  households  reporting. 
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Table  10,-  Characteristics  of  households  by  status^ 
New  York  Metrooolitan  Area 


1/ 


Characteristics 


310 
recraited 
households 


121  2/ 

refusal 
households 


212  3/ 

reporting 
households 


98  3/ 
dropped 
households 


Sampling  area: 

Five  boroughs  .  . 
Remainder  of  area 


Age  of  household  head: 
20  -  3U  years  .  . 
3S  -   U9  years  .  . 
50  years  and  over 

Race: 

White   

Negro  and  other  , 


Total  household  income: 
Under  $6,000  .  .  . 
$6,000  and  over 


Employment  of  vife: 
Not  outside  home 
Outside  home  ,  , 


Number  of  eaters: 
One  ♦  .  .  « 
Two   .... 

Three  .  .  . 
Four  .... 
Five  or  more 


Ratio  of  meals  prepared 
to  total  possible  meals: 


0,00 
.60 
.70 
.80 
.90 


0.59 
.69 
.79 
.89 

1.00 


Ownership  of  home: 
Own  home  or 

furnished  quarters 
Rent  home  


Percent 

58 
U2 


22 
II2 


90 

lo 


75 


67 
33 


7 
23 


6 

6 

13 
23 

S2 


33 
67 


Percent 

62 

38 


12 


96 


6li 
IE 


72 

28 


10 

3l 

7 


10 
10 

15 
26 
38 


39 
61 


percent 
$6 


22 
U2 
36 


91 
9 


Ik 
26 


67 

33 


9 

2U 

23 
22 

23 


6 

ll 

21 


38 
-57 


Percent 

62 
38 


21 
U2 
37 


88 
12 


77 
23 


67 

33 


5 
23 
17 
29 
26 


7 

H 
IF 
25 

39 


21 
77 
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Table  l-J.-  Characteristics  of  households  by  status^-  Continued 


Characteristics 


Rent  paid  by  those  who  rent; 
0  -  ^3k.99 
$35.00  -  ^5U.99 
|55oOO  or  more 


Total  meals  eaten  in 
0-21  meals  . 
22  -  ii2  meals  . 
U3  -  63  meals  . 
6U  -  8I4  meals  , 
85  meals   or  more 


310 
recruited 
households' 


121  2/ 
refusal 
households 


2123/      98  3/ 
reporting  dropped 
households  households 


Meals  prepared  to  be  taken  out 

No  meals   «  .  . 

1-5  meals  » 

6-10  meals  . 

11  -  15  meals  . 

16  -  35  meals  . 


Weekly  food  expenditure  for 
home  consumption: 

0  -  $15.00  .  . 

^pl6.00  -  $30.00  .  . 
^31.00  -  $i^5. 00  .  . 
^^6.00  -5100,00  .  . 


Store  usually  patronized 
No  single  one  .  ,  . 
An  independent  .  . 
A  chain 


Education  of  headj 

0  -  8  years  .  . 
9-12  years  .  , 
13  years  or  more 


Percent 

38 
UO 
22 


8 
21 


58 

28 

8 

h 
2 


18 

SS 

22 

5 


36 


37 

UO 
23 


Percent 

31 

3h 
3h 


12 

3? 


68 
25 

h 
h 


16 

63 

19 

2 


19 


39 
39 
23 


Percent 

UO 

37 
22 


9 

2ii 
25 
20 
22 


57 

27 

9 

5 

2 


18 
56 

19 
6 


3U 
20 
U6 


35 
iil 
23 


Percent 

33 
U6 
21 


k 
28 
26 
21 
21 


62 

30 
6 
1 

1 


17 
52 

29 

2 


39 
2U 
38 


hi 
38 
21 


1/  The  entries  are  underscored  for  those  characteristics  having  a  value 
of  chi-square  which  is  beyond  the  5-percent  level  of  significance. 

2/  Information  was  obtained  on  household  characteristics  for  only  a  subsample 
of~121  out  of  210  refusal  households. 

3/  The  last  two  columns  represent  a  breakdown  of  the  310  recruited  households, 
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Table  11.-  Characteristics  of  the  current  active  sample  households 
compared  with  the  original  probability  sample, 
Mew  York  Metropolitan  Area 


Household 
characteristics 


Original 

sample 

($20  households; 


Active  sample 
in  tabulation 
(361  households) 


Area: 


5  Boroughs 
Remainder 


Race  I 


White 
Other 


Family  size: 

1  &  2  members 

3 

U  &  5   " 

6  k   more   .  . 


Education  of  head 
of  household: 
Grammar  .  . 
High  School 
College   .  . 


Age  of  housewife: 

-35 

35  -  Ul4     .... 
U5  ajid  over     .    . 

Age  of  household  head: 

-^S 

3S  -  hh    .... 


U5  and  over     .  . 

Family  income: 

-51,000     .    .    .  . 

«1,000   -  1,999  . 

2,000  -  2,999  . 

3,000  -  3,999  . 

li,000  -  1^,999  . 

5,000  -  6,999  . 

7,000  -  8,999  . 

9,000  and  over. 


Percent 

59 
Ul 


92 

8 


3li 

23 

3U 

9 


37 
U2 
21 


31 
27 
U2 


21 

29 
50 


3 
6 
18 
18 
18 
22 

9 
6 


Percent 

ko 


9U 

6 


31 

25 

33 
6 


39 

U2 

19 


23 
36 
36 


20 
31 
li9 


1 

5 

17 

26 

20 

20 

6 

5 
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